# fio -filename=/tmp/test_randread  -direct=1 -iodepth 1 -thread -rw=write -ioengine=psync -bs=16k -size=30G -numjobs=10 -runtime=60 -group_reporting -name=mytest  

mytest: (g=0): rw=write, bs=16K-16K/16K-16K, ioengine=psync, iodepth=1

...

mytest: (g=0): rw=write, bs=16K-16K/16K-16K, ioengine=psync, iodepth=1

fio 2.0.7

Starting 10 threads

Jobs: 10 (f=10): [WWWWWWWWWW] [100.0% done] [0K/364.3M /s] [0 /22.3K iops] [eta 00m:00s]

mytest: (groupid=0, jobs=10): err= 0: pid=74873

  write: io=20336MB, bw=347058KB/s, iops=21691 , runt= 60001msec

    clat (usec): min=28 , max=203809 , avg=459.64, stdev=3726.22

     lat (usec): min=29 , max=203810 , avg=460.27, stdev=3726.26

    clat percentiles (usec):

     |  1.00th=[   30],  5.00th=[   31], 10.00th=[   34], 20.00th=[   35],

     | 30.00th=[   36], 40.00th=[   37], 50.00th=[   38], 60.00th=[   40],

     | 70.00th=[   43], 80.00th=[   46], 90.00th=[  620], 95.00th=[ 1144],

     | 99.00th=[ 8512], 99.50th=[22912], 99.90th=[58624], 99.95th=[75264],

     | 99.99th=[110080]

    bw (KB/s)  : min=  265, max=396352, per=10.16%, avg=35260.37, stdev=80519.69

    lat (usec) : 50=82.89%, 100=6.31%, 250=0.31%, 500=0.02%, 750=1.73%

    lat (usec) : 1000=2.50%

    lat (msec) : 2=4.37%, 4=0.57%, 10=0.37%, 20=0.36%, 50=0.42%

    lat (msec) : 100=0.14%, 250=0.01%

  cpu          : usr=5.67%, sys=24.37%, ctx=26086439, majf=0, minf=12681

  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%

     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

     issued    : total=r=0/w=1301489/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):

WRITE: io=20336MB, aggrb=347057KB/s, minb=347057KB/s, maxb=347057KB/s, mint=60001msec, maxt=60001msec

Disk stats (read/write):

  sda: ios=0/1300195, merge=0/12, ticks=0/46837, in_queue=46516, util=77.53%